epi draft 



Herding model and 1/f noise 

J. RUSECKAS, B. Kaulakys and V. Gontis 

Institute of Theoretical Physics and Astronomy, Vilnius University, A. Gostauto 12, LT-01108 Vilnius, Lithuania 



PACS 05. 40. -a - Fluctuation phenomena, random processes, noise, and Brownian motion 
PACS 89.65.Gh - Economics; econophysics, financial markets, business and management 
PACS 05 . 10 . Gg - Stochastic analysis methods 

Abstract - We provide evidence that for some values of the parameters a simple agent based 
model, describing herding behavior, yields signals with 1/f power spectral density. We derive 
a non-linear stochastic differential equation for the ratio of number of agents and show, that it 
has the form proposed earlier for modeling of 1/ f^ noise with different exponents /3. The non- 
linear terms in the transition probabilities, quantifying the herding behavior, are crucial to the 
appearance of 1/f noise. Thus, the herding dynamics can be seen as a microscopic explanation of 
the proposed non-linear stochastic differential equations generating signals with 1/ f^ spectrum. 
We also consider the possible feedback of macroscopic state on microscopic transition probabilities 
strengthening the non-linearity of equations and providing more opportunities in the modeling of 
processes exhibiting power-law statistics. 
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, Introduction. — Kirman's seminal herding model 

■ J>was introduced in Refs. [BIS]- This is a simple stochas- 
, ^Dtiic model of information transmission initially designed 
' ^^to explain the herding behavior in ant colonies, gathering 
, food from two identical sources located in their neighbor- 
• hood. Kirman noticed that entomologists and economists 
, ^ I qbserve similar patterns in rather different systems. If 
' I there are two identical food sources available to ants in a 
, qolony, majority of ants still tend to use only a single food 
' !* source at any given time. Furthermore, switches to the 
I .^r).ew food source occur despite the fact that food sources 
remain identical [3]. Human crowd behavior tends to be 
. ^ quite similar, at least in statistical sense. There are ob- 
>■ - - servations that majority of people tend to choose more 
popular product, than less popular, despite both being of 
a similar quality. The article [5] also cites numerous works, 
which speculate that herding behavior might be related to 
the fluctuations of asset price. In Kirman's formalization 
the switching probabilities do not depend on the source, 
thus probability distribution of ant's visiting times at both 
mangers is symmetric. 

Kirman's model and similar approaches have been ap- 
plied as models of herding and contagion phenomena in 
financial markets [Tl|4j[5|. In ref. [6] the equilibrium dis- 
tribution of the related discrete-time stochastic process 
within the more general theoretical framework of Polya 
urn processes has been derived. The associated Fokker- 
Planck equation for the pertinent continuous symmetric 



dynamic process has been derived and solved in ref. [7]. 
The parameters of Kirman's herding model applied to the 
description of financial markets were estimated in ref. [8] 
by introduction of a simulated moment approach extract- 
ing two key parameters of the model via matching of the 
empirical kurtosis and the first autocorrelation coefficient 
of squared returns. A direct estimation of the parameters 
of a related agent-based model, based on a closed-form 
solution of the unconditional distribution of returns, has 
been proposed in ref. [S]. The Kirman model was gener- 
alized in ref. [T^ . It is worth to notice that the appropri- 
ate agent-based models can yield emergence the power-law 
scaling, long-range correlations, (multi)fractality and fat 
tails (see, e.g., [m[T2] and references herein), however the 
omnipresent 1/f noise have not yet been revealed in such 
approach. 

The phrases "1// noise", "1// fluctuations", and 
"flicker noise" refer to the phenomenon, having the power 
spectral density at low frequencies / of signals of the form 
S{f) ~ 1//'', with /3 being a system-dependent param- 
eter. Power-law distributions of spectra of signals with 
0.5 < /3 < 1.5, as well as scaling behavior in general, are 
ubiquitous in physics and in many other fields, including 
natural phenomena, human activities, traffics in computer 
networks and financial markets [T3H53]- This subject has 
been a hot research topic for many decades (see, e.g., a 
bibliographic list of papers by Li [21], and a short review 
in Scholarpedia |13p. Despite the numerous models and 



X 



p-1 



J. Ruseckas et al. 



theories proposed since its discovery more than 80 years 
ago [iniHn], the subject of 1// noise remains still open 
for new discoveries. Most of the models and theories are 
not universal because of the assumptions specific to the 
problem under consideration. In 1987 Bak et al [27| intro- 
duced the notion of self-organized criticality (SOC) with 
the motivation to explain the universality of 1// noise, 
as well. Although the paper [37] is the most cited pa- 
per in the field of 1// noise problems, it was shown later 
on [28l[29] that the mechanism proposed in [27] results in 
l/f^ fluctuations with 1.5 < /? < 2 and does not explain 
the omnipresence of 1/f noise. On the other hand, we can 
point to a recent paper [30j where an example of 1/f noise 
in the classical sandpile model has been provided. A short 
categorization of the theories and models of 1// noise is 
presented in the introduction of the paper |31j . 

Recently, the nonlinear stochastic differential equations 
(SDEs) generating signals with 1/f noise were obtained in 
Refs. [531155] (see also recent paper [21]), starting from the 
point process model of 1/f noise [34^139j . Nonlinear SDEs 
provide macroscopic description of a complex system. Mi- 
croscopic, agent based reasoning of equations exhibiting 
1/f noise can yield further insights into behavior of the 
system. In this paper we show that it is possible to ob- 
tain nonlinear SDE of the form of Refs. [32j[33] starting 
from agent-based herding model. Thus, it is possible to 
show analytically that nonlinear nature of herding inter- 
actions and appropriate choice of variable results in 1/f 
fluctuations. 

The herding model. — In papers [T]|2]|4] Kirman em- 
ployed a simple model to describe the behavior of a multi- 
tude of heterogeneous interacting agents. In the model the 
dynamic evolution is described as a Markov chain. There 
is a fixed number of agents, each of them being in state 
1 or in state 2. The number of agents in the first state 
is denoted by n, and the number in the second state by 
N — n. The core of Kirman's model is the pairwise interac- 
tion governing the transition of the agents between the two 
states. Neither the probability of following another com- 
panion nor the success in recruiting companions depend 
on the outcome of previous meetings. The lack of mem- 
ory of the agents is the crucial assumption to formalize the 
population dynamics as a Markov process. Describing the 
dynamics as a jump Markov process in continuous time, 
the transition probabilities per unit time are given by 

p{n n + l)= p'^{n) = (A - ?i)(cri + hn) , (1) 
p{n -^n-l)= p^{n) = n{a2 + h{N - n)) . (2) 

The above probabilities define a one-step stochastic pro- 
cess [ini- The constants cti and tT2 describe the idiosyn- 
cratic propensity to change the state, while the term h 
describes the herding tendency. We allow the two con- 
stant parameters cti and (J2 to assume different values, 
generating asymmetric behavior. The non-linearity in the 
transition probabilities ([T]) and ([5]) constitutes a crucial 
ingredient of the model: the presence of non-linear terms. 



is the imprint of interactions among agents. The linear 
terms would imply independence of the behavior of the 
agents. 

The transition rates ([T]) and ^ describe a scenario 
where the interaction among agents does not depend on 
the fraction of agents in the alternative states, but rather 
on the overall number of such agents. Such a choice 
makes the transition rates nonextcnsive. the connectiv- 
ity between agents increases with the number of agents 
A^. The interactions have a global character, the range of 
the correlations involves a macroscopic fraction of agents. 
This means that temporal correlations in the level of fiuc- 
tuations might be observed for any system size. Wc will 
show further that such non-linear terms in the transition 
probabilities leads to 1/f behavior of the power spectral 
density. 

The transition probabilities imply the Master equation 
for the probability P„ {t) to find n agents in the state 1 at 
time t [10] : 

^P„ = p+{n - l)P„_i +p-{n + l)Pn+i 

-{p+{n)+p-{n))P^. (3) 

For large enough A^ we can represent the group dynam- 
ics by a continuous variable x = n/N. Using standard 
methods from ref. [3D], a Fokker-Planck equation is de- 
rived from the Master equation ([3]) assuming that A^ is 
large and neglecting the terms of the order of l/N"^: 

d d 

— P,(x,t) = - x) - e2x)P^ix,t) 

+ ('^(' - 0.) + |(1 - X) -f |x) PAx,t) , (4) 

where £i = ai/h, £2 = 02 /h are scaled parameters. In 
the following we will ignore the terms of the order of 1/A^ 
in the diffusion term in eq. ([1]), assuming that variable x 
is not too close to the boundaries a; = and x = 1, i.e., 
X » £i/N and 1 — a; ^ £2/^. In addition we assume 
that £1,62 > 0. Thus the Fokker-Planck equation for the 
herding model has the form 

d d 

— Px{x,t) = -—h{£i{l - X)- £2x)Px{x,t) 

+ Q^hx{l-x)P^{x,t). (5) 

This Fokker-Planck equation corresponds to the stochastic 
differential equation 

dx ^ h{£i{l - x) - £2x)dt + y^2hx{l ~ x)dW , (6) 

where is a standard Wiener process (the Brownian mo- 
tion). The steady-state solution of eq. ([S]) has the form 
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Eqs. ©-([T]) were obtained in ref. [H]- 

Using El =62 in cq. ([7]) we recover the equilibrium dis- 
tribution as in ref. [5]. The distribution ([7]) exhibits a 
unique mode if both parameters take a value larger than 
1, while it shows bi- modality for the case £1,62 < 1. Fur- 
thermore, the distribution shows a monotonic behavior if 
one parameter is larger than 1 and the other smaller than 
1. 

Nonlinear stochastic difTerential equation gener- 
ating signals with l//*^ noise. — Starting from the 
point process model, proposed and analyzed in Refs. [341 - 
139) . the nonlinear SDEs generating processes with 1//^ 
noise are derived PTH55] . The general expression for the 
proposed class of Ito SDEs is 

dx = a^(^7^-^X^x^"-^dt + ax'^dW. (8) 

Here x is the signal, ?/ 7^ 1 is the power-law exponent of the 
multiplicative noise, A defines the behavior of stationary 
probability distribution, and is a standard Wiener pro- 
cess (the Brownian motion). The Fokker-Planck equation 
corresponding to SDE ([5]) gives the power-law probability 
density function (PDF) of the signal intensity Po{x) ^ x^^ 
with the exponent A. In Refs. [321133 it was shown that 
SDE ([SI) generates signals with power spectral density 

SU)-^,, ^-1+2^- (9) 

The nonlinear SDE ([8]) has the simplest form of the mul- 
tiplicative noise term, ax^dW. Multiplicative equations 
with the drift coefficient proportional to the Stratonovich 
drift correction for transformation from the Stratonovich 
to the Ito stochastic equation |5T] generate signals with 
the power-law distributions [31] . Equation ([8]) is of such a 
type and has the stationary PDF of the power-law form. 
The connection of the power spectral density of the signal 
generated by SDE ([S|) with the behavior of the eigenvalues 
of the corresponding Fokker-Planck equation was analyzed 
in ref. [42]. In ref. [43] it is shown that 1//^ noise is equiv- 
alent to a Markovian eigenstructure power relation. 

SDE ^ exhibits the following scaling property: chang- 
ing the stochastic variable from x to a scaled variable x' = 
ax changes the time-scale of the equation to t' = a'^'-^~^h, 
leaving the from of the equation unchanged. This scaling 
property is one of the reasons for the appearance of the 
1//^ power spectral density. 

Another remarkable property of SDE ([5]) is the behavior 
under transformation of the variable x: if instead of x we 
introduce 

y = x", (10) 
then from eq. ([8]) we get the equation of the same type 

dy = a'^ [r^ - ^ y^V-i^t + y^i m , (11) 



only with different parameters tr' = acr, 77' = (77 — 1) /a -1-1, 
A' = (A - l)/a-h 1. 

For A > 1 the distribution Pq{x) diverges as a; — 0, 
therefore the diffusion of stochastic variable x should be 
restricted at least from the side of small values, or equa- 
tion ([HI should be modified. The simplest choice of the re- 
striction is the reflective boundary conditions at a; = Xmin 
and X = a;„iax- However, other forms of restrictions are 
possible and have been considered, as well. Exponentially 
restricted diffusion is generated by the SDE 

da; = ^2 L - Ia + ^ f ^ - x^^-^dt 
[ 2 2 V a;™ x^^^)\ 

+ ax'^dW (12) 

obtained from eq. ([S|) by introducing the additional terms. 

For A = 3 we get that /? = 1 and SDE ([5]) gives signal 
exhibiting 1// noise. Numerical solution of the equations 
confirms the presence of the frequency region for which 
the power spectral density has dependence. The 

width of this region can be increased by increasing the 
ratio between the minimum and the maximum values of 
the stochastic variable x. In addition, the region in the 
power spectral density with the power-law behavior de- 
pends on the exponent 77: if 77 = 1 then this width is zero; 
the width increases with increasing the difference |?/ — 1| 

m- 

For some choices of parameters, SDE ([8]) or its variant 
(|12p takes the form of the well-known SDEs considered in 
econopysics and finance. In case when the exponent of 
multiplicative noise 77 = and cr = 1, ([5]) takes the form 
of the SDE for the Bessel process [H] , 

dx = ^—^-dt + dW , (13) 
2 X 

of dimension S = 1 — A, while rj = 1/2 and a = 2 corre- 
sponds to the squared Bessel process [44] , 

da- = 5dt + 2^/^dW , (14) 

of dimension 5 = 2(1 — A). SDE with exponential restric- 
tion (|12D for 7/ = 1/2, Xmin = and m = 1 gives the 
C OX- Inger soil- Ross (CIR) process [44], 

dx = k{9 - x)dt + ay/^dW , (15) 

where k = (T^/2xniax and = a;max(l — A). When u = 27], 
a^max = 00 and m ~ 2ri — 2 then eq. (|12[) takes the form of 
the Constant Elasticity of Variance (CEV) process [44) . 

dx = fixdt + ax''dW , (16) 

where = a^{ri - l)x^J,^~^^ ■ 

The numerical analysis of the proposed SDE ([5]) reveals 
the secondary structure of the signal composed of peaks 
or bursts, corresponding to the large deviations of the 
variable x from the proper average fluctuations. Bursts 
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are characterized by power-law distributions of burst size, 
burst duration, and interburst time [3T]. Therefore, pro- 
posed nonlinear SDEs may simulate avalanches in self- 
organized critical (SOC) models and extreme event return 
times in long memory processes. 

Herding model and 1/f noise. Let us consider 
the case when x <C 1. Then SDE ^ approximately has 
the form 



da; ~ h{ei — e2x)dt 



(17) 



Eq. (IT71) has the form of our nonlinear SDE ^ with 
the multiplicative noise and having parameters rj = 1/2, 
A = 1 — El. The term with £2 in eq. ((TT)) gives restrictions 
at larger x. The possible values of the parameter ei are 
restricted to ei > and this limits the possible values of 
the exponents A and f3. In particular, it is not possible 
to obtain 1// noise with /? = 1 for the herding dynam- 
ics of population x. Nevertheless, the nonlinear form of 
Eq. ((T7| allows to apply transformation ((TO)) and get a 
flexible choice of variables and corresponding exponents A 
and f3. 

One possible choice is to consider y — 1/a;, having 
a = — 1 in cc^. (fTU)) . The range of possible values of l/x is 
[1, +CX)). Since only large values of y are relevant for ob- 
taining 1/f noise, this range can be extended to include 
zero by introducing y = 1/x—l = {l — x)/x. This variable 
y has a clear interpretation: it is equal to the ratio of the 
number of agents in the state 2 to the number of agents 
in the state 1: 



1 



N 



y 



(18) 



A stochastic variable similar to y (fT8)) was used in ref. I9| 
to model absolute return, while our variable x corresponds 
to a fraction of fundamentalists in ref. [5] • Transformation 
(UHl) of variables leads from SDE © to 



dy-/i[(2-ei)j/ + e2](l 

Similar equation has been obtained in ref. 
state PDF of the new variable y is 



Po{y) 



r(£i+£2) y''-' 



y)dW. (19) 
S] . Steady 



(20) 



r(£2)r(£i) (i + y)^^+^i ■ 

When 2/^1 then eq. p9|) approximately has the form 

dy^h{2-ei)y^dt + V2hyidW. (21) 

Eq. (pij) has the form of our nonlinear SDE ([5]) with mul- 
tiplicative noise, having parameters 77 = 3/2, A = 1 + £1. 
Eq. ((2T|) is similar to a well known 3/2 model of stochastic 
volatility [46]. According to eq. ([9]), the power exponent 
of the power spectral density is /3 = £1 — 1. If £1 = 2, we 
obtain 1/f spectrum. Thus it is possible to obtain a signal 
with 1/f noise starting form the herding model. SDE ([T^ 
demonstrates yet another possible form of the restriction 
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Fig. 1: (Color online) Steady state PDF Po{y) (upper panel) 
and power spectral density <S'(/) (lower panel) of the signal gen- 
erated by eq. p9p . The dashed (green) lines are the analytical 
expression H20|) for the steady state PDF (upper panel) and the 
slope 1/f (lower panel). The parameters used are ei = £2 = 2 
and h = 1. 



of diffusion of the stochastic variable in SDE (|5]) from the 
side of small values. It is of interest to note, that the 
strong herding tendency for h > u\/2 (ei < 2) yields the 
long-range process with /3 < 1, the power- law correlation 
C(i) ~ 1/i^"^, and distribution (gHl) with the diverging 
variance. 

Comparison of numerically obtained steady state PDF 
and power spectral density of the signal generated by 
eq. ([T9| with analytical expressions is presented in fig. [T] 
For the numerical solution we use Euler-Marujama ap- 
proximation with variable step of integration, transform- 
ing the differential equations to the difference equations 
[5^155] . We see a good agreement of the numerical results 
with the analytical expressions. Numerical solution of the 
equations confirms the presence of the frequency region 
for which the power spectral density has 1/f dependence. 

For the comparison, steady state PDF and power spec- 
tral density of the stochastic variable y calculated using 
the number of agents n according to eq. ([T5)) . is presented 
if fig. [5J The number of agents n is obtained from the jump 
process defined by the transition probabilities ((T|) and ^ . 
We see a good agreement of the numerical results with 
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Fig. 2: (Color online) Steady state PDF Po{y) (upper panel) 
and power spectral density S{f) (lower panel) of the stochastic 
variable y calculated according to eq. (|18|l . using the number of 
agents n obtained from the jump process defined by the tran- 
sition probabilities ^ and The dashed (green) lines are 
the analytical expression (|2Up for the steady state PDF (upper 
panel) and the slope 1/f (lower panel). The total number of 
agents is A'^ = 10000, other parameters are the same as in fig.[T] 

the analytical expressions. Thus, numerical calculations 
confirm the SDE ([T]) and the possibility to obtain 1/f 
spectrum from a herding model. 

Possible generalizations. — One of the possible gen- 
eralizations of the model presented above is to consider a 
stochastic variable y defined as 



y 



1 



1/q 



(22) 



Then the transformation of variables leads from SDE (|6]) 
to the SDE 

= ^ [(1 + i - ei) + (£2 + ^ - 1) y-"] 2/(1 + y")dt 

+ ^yi-f(l + y")diy. (23) 



The corresponding steady state PDF is 



Poiy) 



aViei + S2) 



y^ 



T{e2)T{ei) (1 + ) 



£2+61 



(24) 



It should be noted that PDF for some choice of pa- 
rameters has the form of distributions featured in nonex- 
tensive statistical mechanics : the values of the pa- 

rameters a = 1, £2 = 1 correspond to g-exponential dis- 
tribution with q = 1 + 1/(1-1- El) and the values of the 
parameters a = 2, £2 = 1/2 correspond to g-Gaussian dis- 
tribution with g = 1-1-2/(1-1- 2£i). When y ^ 1 then we 
get SDE ^ with parameters ij = l + a/2, A = l-f-a£i. 
According to eq. ([9]), the power exponent of the power 
spectral density is /3 = £1 -I- 1 — 2/ a. 

Another way to generalize the herding model is to in- 
troduce the additional non-linearities into transition prob- 
abilities ([!]) and (O. The original transition probabilities 
((TJ and (0) assume that agents meet at a constant rate 
and therefore the coefficients ci, (T2 and h are constant. 
One possibility to extend the model is to assume that the 
rate at which the agents meet depends on the global state 
of the system. In such a situation the new transition prob- 
abilities can be written as 

p(n ^ n+ 1) = —l—(N - n)(ai + hn) , (25) 
T(n) 



p(n — >■ n — 1) 



r(n) 



n{a2 + h{N - n)) , (26) 



where T[n) describes the time scale of the microscopic 
events. Assuming that the time scale r depends only on 
the ratio x = n/N , the SDE obtained form the modified 
model instead of eq. ^ has the form 



Ax = ^{ei{\-x)-e2x)At+J2^x{l~x)AW, (27) 
T{x) y t[x) 

whereas the SDE for the variable y — {\ ~ x)/x is 

dy - [(2 - £i)y + £2] (1 + 2/)di + J 2-^y (1 + y)dl^ . 

(28) 

Here Ty{y) = t(1/(1 + y)). Similar modification of the 
herding model has been proposed in ref. j45j . 

Let us consider the case of r(y) = y~'^ . Then eq. 
becomes 



Ay = h[{2 - £i)y + £2]2;^(1 + y)At + y^2ky^{l + y)AW . 

(29) 

In the limit y ^ 1 wc get SDE ([5]) with parameters rj = 
3/2 + 7/2, A = £1 + 1 + 7. According to eq. dH]), the power 
exponent of the power spectral density is 



2(,7-l) 



1 + 7 



(30) 



Thus we have shown that it is possible to obtain different 
values of the parameter rj in eq. ^ . 

Conclusions. — Starting from a simple agent-based 
model describing herding behavior we obtained non-linear 
SDE for the agent population x equal to the fraction of 
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agents in the state 1. For x ^ 1 this non-Hnear SDE has 
the form similar to SDE proposed in Refs. [5^155] for the 
modeUng of 1// noise. This form suggests that it might 
be possible with the appropriate transformation of vari- 
ables to obtain signals having 1/f behavior of the power 
spectral density from this agent model. However, the pos- 
sible values of the parameter Si in the model, eq. (jl7p . are 
restricted to the positive values and this limits the values 
of the exponents A and P of the power-law statistics. The 
solution is to consider not the fraction of agents x, but an- 
other variable y, equal to the ratio of number of agents in 
the state 2 to the number of agents in the state 1. This new 
variable is related to x by a simple transformation. The 
non-linear SDE for the stochastic variable y in the limit 
of large values ?/ S> 1 has the required form for obtaining 
1/f noise. This result shows that it is possible to obtain 
1/f noise starting from the agent-based herding model 
and introducing the appropriate variables. These analyti- 
cal results are checked by numerical calculations, showing 
good agreement with analytical predictions. Thus, herd- 
ing dynamics can be seen as a microscopic explanation 
of proposed non-linear SDEs generating signals with 1//^ 
spectrum. The derivation of SDEs shows that non-linear 
terms in the transition probabilities, describing global in- 
teractions between agents, are crucial to the appearance of 
1/f noise. The exponents A and /? of the power-law statis- 
tics can be adjusted by introducing feedback between the 
macroscopic system state x and the rate of the micro- 
scopic events l/r(x). Application of the similar model for 
description of the return in the finacial markets has been 
proposed in ref. [45] . 
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